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Field of invention 

filters. 



Background of the invention 

1 5 Dilation and erosion of imaees are 

images are operations commonly used i n image 

analysis. Both of these operations depend on finding the maxhnurn o, • - 

s uxc maximum, or minimum, 
value of an input and assknim. that value t,h.~. • 

emus mat value (the maxrmum or minimum value) to the 

output of the diiation « erosion wimin . j^uu mge . 

" ^ 2 **" "» *> » *~ output „ otaima by 

^•oeachptxelmei^vaineofme.pi^mn.o.ofi, Ini^vbe 

25 expressed as.- 
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for any given pixel Y, 

let Y have the value of the tuaximum value of the selected from the group 
consisting of, Y, Y+l, Y+2, Y-K3, Y+4, Y+5, Y-H>, Y+7. 
or simply: 



y, = max Xuj 

maxO£/<p 



where j/> the output unit being dealt, ^is the input corresponding to the 
output datum , p is the specified number of data inputs, in this case, 8, and j is all 

the values from 0 to p-1 . Erosion is essentially the same as dilation, the only 

difference being that for erosion max is replaced by min. 
1 0 A challenge is to find all the values of y, in the most efficient manner. It is 

possible to obtain all the values for y with p comparisons per datum. One goes 

through all the datum and compares each datum with each of the p data in front of it 

and for the output, uses the largest of those comparisons. 

The Gil- Warner van Herk algorithm is a way to process the min and max 
1 5 values of a given input regardless of the value of p. There are 3 steps to the Gil- 

Werman van Herk Algorithm (hereafter referred to as GWVH): 

1 * Partitioning the data into overlapping segments of size 2p- 1 

2. Creating values 7?* and ^ per datum per segment 

3, Merging the R k and $ k values to obtain the largest value per 

20 datum 

Partitioning the data: 

The incoming data is partitioned into overlapping segments of size 2p-l, 
each segment centered at Xp . r > X 2p -\ > Jt^., - • »■ For example, if the incoming 
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*<>X*>Xu>X 19 >Xia>Xi 9 >Xm ma Xh- That is 



10 



15 



20 



Creating values and & per datum per seg^ 

* GWVH aigcrith™ starts at the center of each ^ and gives the 

.EEachcenters^en,, ^ ^ & 
-gment Each da,™ is ft. gi ve „ „ & ^ & ^ ^ fe ^ 

^ & values: 

for each value of k (Where k goes from 0 to p-I) the GWVH algorithm 
compares the value ofthe current Datum wiA the vdue of ^.format 
segment, and assigns & f 0r the current datum to the larger of those two. 

For example in th e above case (41 datum Q ^ ^ 

looking at the third segment: 

1^0, The GWVH algorithm assigns R k (in this instance fa , 
as k=0) for 14 to whatever 14 i s (14 is the center of the third segment). 
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k=l /Then, the GWVH algorithm looks at datum 13, and 
compares the value of datum 1 3 to the value of for that segment 
(in this case, R 0 of the third segment) and assigns R k for the current 
datum (In this case, ^ of the third segment) to the greater of the 2 
5 values. 

k=2,Then, the GWVH algorithm looks at datum 12, and 
compares the value of datum 12 to the value of ^ , for that segment 
(in this case, R x of the third segment) and assigns R k for the current 
datum (In this case, R 2 of the third segment) to the greater of the 2 
10 values. 

k=3,Then, the GWVH algorithm looks at datum 11, and 
compares the value of datum 1 1 to the value of R k _ } for that segment 
(in this case, ^ 2 of the third segment) and assigns R k for the currenL 
datum (In this case, Q of the third segment) to the greater of the 2 
15 values. 

k^4,Then, the GWVH algorithm looks at datum 10, and 
compares the value of datum 1 0 to the value of ^ for that segment 

(in this case, ^ of the third segment) and assigns J£ k for the current 
datum (In this case, J£ 4 of the third segment) to the greater of the 2 
20 values. 

or s expressed more simply: 

R k = ^(Xj>Xj-^> XjJ 
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where is the center of each segment, and k=O v ..p-l . 
The $ k values: 

The £ are computed the same way as the ft k values, except that as k 
5 increases you look at the higher values of datum, so in the third segment 

where k = 0 is still the value of datum 14, but § t when k is one is the 

larger of datum 14 7 and datum 15. The equation for $ k is: 

S k = m *xbj>Xj+\>~>XjJ- 
Having generated an R h and j$ k for each datum, the GWVH algorithm 

10 proceeds to merge various J£ k and $ k values to find the max filter as follows: 
The original definition for the max filter looks like: 

y { = max x i+J 

raax0£/</7 

The algorithm substitutes max(j C ^ Jt5X>(jt _ ir ... x>J jc J+1 v..x > ^-A-i) for 
15 niaXJC<+y* Considering the above substitution, jj^ax ™P^ es ta ^8 ^ 

mar 0^ j<p max 0£ j<p 

largest value of any given X, from through , - Considering the substitution 

">w(x^.X y ^H).-Xy.X /( ,-X^ > at Xj-k for ****** values of 3 md L 
The algorithm is required find the max value from % through Xj-k*p-i ' w^ 0 ^ 1S m 
fact what has been done. Having defined R t and g k over all the different 
20 segments, the algorithm must detennine t^iXj-^Xj^-iy-XpXj^-^Xj^kJ for 
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agivenj.andagivenk. Having detennined that the between a current datum and 
the next center datum is the largest value between the current datum and the next 
center datum, the algorithm need no longer compare the current datum with any data 
other than the R k of this datum until th e next center datum. From the next center 
5 datum on, the g k 5 s remain the same or increase (are monotonically increasing), so to 
find the largest value from the next mid datum on, the GWVH algorithm chooses the 
correct g k of the current segment, which is the datum p-1 away from the current 
datum, namely the datum S P -t-i °f this segment, remembering that for any given 
segment g Q is the mid datum, therefore $ p is p away from the mid datum. The 

10 definition requires the output for any given datura to be the largest of itself and the p- 
1 data in front of it. The algorithm need not compare a datum p away, as it requires 
the largest of the current datum, and all the datum p-1 from it Using the above 
definition the current datum is k behind the next mid datum, where k may be 0, so the 
algorithm uses the datum that is p-k-1 past the mid datum of the section that the 

1 5 current datum has an J£ k value of, thus value of datum $ t _ x - Once the GWVH 

algorithm has determined the J£ k and g , there is one comparison to do to find the 
max value for any given datum* namely: 

X- w max Xi + y = ^(x,^jc y -* + iv-^ 

max 0zj<p 

The GWVH algorithm does 1 comparison per datum for each J^ k and one 
20 comparison for each £J k . It then does one comparison for to determine the max over 

p for any given datum, giving a total of 3 comparisons per datum, regardless of the 
size of p. It should be noted that for the cases of kH), and fc=p- 1 there is no need to do 
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a comparison, one can simply choose the appropriate R k or ^^(k^O, 
R k ), without having to do the comparison. 

In image analysis, it is often useful to take the opening, or the closing filter, 
that is, for the opening filter, filtering the data through a max filter, and then taking 

5 the output of the data, and running it through a min filter, or, for the closing filter, 
taking the data and running it through a min filter, and then taking the data and 
running it through a max filter. The above algorithm takes approximately 6 
comparisons per data datum. Image analysis can be expensive in terms of computer 
time, and it is useful to find ways of shortening the amount of processing needed to do 

10 any given operation. 



Summary of the invention 

According to the first aspect of the present invention, there is thus provided a 
device capable of efficiently computing morphological min and max, opening and 
15 closing filters. 

According to a first aspect of the present invention there is provided data 
filtering apparatus comprising: 

an input for receiving a stream of data, each data item taking a range of at least 
two values ranging between a low value to a high value, 
20 a segmentation device for dividing said stream into segments, 

a segment midpoint definer for defining a midpoint of each segment, 

a segment orderer for ordering said segment in a first direction from low to 
high on a first side of said midpoint and in a second direction from low to high on a 
second side of said midpoint. 
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an extremity filter unit for comparing said ordered data on either side of said 
midpoint to create a temporary output per segment, for each segment, each data item 
on either side of said midpoint being given an extremity filter value, said filter unit 
being operable to utilize said ordering to find said extremity value via a irdnimal 
5 number of comparisons, 

said extremity filter for initially comparing a single end of each segment, and 
being operable to alternate between ends per segment, 

said extremity filter being further operable to compute remaining ends via 
comparisons of the middles of presently un-compared ends to the middle of the 
10 compared ends, and to conditionally copy a half of the compared end onto the un- 
compared end. 

Preferably, said extremity filter further is operable to copy the compared end 
of the previous segment. 

Preferably, said extremity filter is operable to copy the compared end of the 
1 5 subsequent segment 

Preferably, said segment orderer is connected to receive segmented data, and 
to re-write the data in each segment such that the data is monotonically increasing 
from the center of each segment forward, and from the back of the segment 
monotonically decreasing to the center of the segment* 
20 Preferably, segment orderer is connected to receive segmented data, and to 

re-write the data in each segment such that the data is monotonically decreasing from 
the center of each segment forward, and from the back of the segment monotonically 
increasing to the center of the segment- 
Preferably, said extremity filter is a maximal filter, and said extremity value 
25 is a maximal value. 
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Alternatively, said extremity filter is a minimal filter, and said extremity value 
is a minimal value. 

Preferably, said segment has an increasing part and a decreasing part, said 
extremity filter being operable to compare the value of the middle of the decreasing 
5 segment with the value at a corresponding position in the increasing segment, and 
further comprises a value copier for copying data values between a front half of the 
increasing segment and a front half of the decreasing segment, the value copier being 
set to copy the data values from the front half of the increasing segment onto the front 
half of the decreasing segment when the compared value in the front segment is 
10 larger, and otherwise to copy the data values from the back half of the back segment 
into the back half of the front segment 

The apparatus may additionally define new segments repeatedly and copying 
parts of each segment, until an end of said input data is reached. 

Preferably,, said segment has an increasing part and a decreasing part, said 
1 5 extremity filter being operable to start with an increasing part of the segment, 
compare a middle value of the decreasing segment part with a correspondingly 
positioned value of the increasing segment part, said extremity filter comprising a 
value copier set to copy the data values from the front half of the decreasing segment 
onto the front half of the back segment when the compared value of the increasing 
20 segment part is smaller, and to copy the data value from the back half of the back 
segment when the compared value of the increasing segment part is larger- 

The apparatus may additionally define new segments repeatedly and copying 
parts of each segment until the data end is reached. 

According to a further aspect of the present invention there is provided an 
25 apparatus for filtering data, comprising; 
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an input for receiving a series of data values ranged between &• low extremity 
and a high extremity, said data values being in segments ordered such that the data is 
monotonically increasing in a first direction from the midpoint and monotonically 
decreasing in a second direction from the midpoint, 
5 a comparator being set to compare the middle value of the first half of each 

segment with the middle value of the second half of the respective segment, the 
comparator setting the copier to copy a respective value from the second segment onto 
the first segment in accordance with the comparison result. 

Alternatively, in accordance with the comparison result, the apparatus is 
10 operable to compute the values of the first segment by comparing them to the 
corresponding values in the second segment. 

Preferably, said data is image data. 

Preferably, said values are intensity values. 

Preferably, said data is digital data, 
1 5 The apparatus may be, connected as a preprocessor for an edge-detection 

device. 

According to a further aspect of the present invention there is provided a 
method for data filtering capable of computing both minimal and maximal values per 
point of a given data input comprising: 
20 comparing two successive data inputs to find a minimum and a maximum 

thereof, 

using the minimum in a minimal filter to produce a minimal filter output 
for said data, 

using the maximum in a maximal filter to produce a maximal filter output 
25 for said data. 
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According to a further aspect of the present invention there is provided a 
method of extremity filtering of a stream of data items, each data item taking a value 
between a low extremity and a high extremity, the method comprising: 

segmenting said data stream into segments of a predetermined length around a 
5 segment midpoint, 

ordering the data in the segment around the midpoint such that on each side of 
the midpoint, successive data items have values which change in only one direction 
between said low and said high extremity, the direction being opposite on each side of 
the midpoint, 

10 for each side of the midpoint, finding a middle data value, 

comparing said respective middle data values of said sector, and 
copying values from one side of said midpoint to the other in accordance with 
the result of the comparison. 

According to a further aspect of the present invention there is provided a 
1 5 method capable of efficiently computing a maximum filter of a minimum filter 
comprising: 

computing the minimum filter using data segmented according to a 
segmentation pattern, 

maintaining said data segmentation pattern of the minimum filter, 
20 passing the data segmentation pattern from the minimum filter to the 

maximum filter, 

the maximum filter using the data segmentation pattern to efficiently compute 
the segment values. 

According to a further aspect of the present invention there is provided a 
25 method of efficiently computing a minimum filter of a maximum filter comprising: 
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computing the maximum filter using data segmented according to a 
segmentation pattern, 

maintaining said data segmentation pattern of the maximum filter, 

passing the data segmentation pattern from the maximum filter to the 
5 minimum filter, 

the minimum filter using the data segmentation pattern to efficiently compute 
the segment values. 

Preferably, a result of said comparison is that a first middle data value of a 
first side of said segment i$ higher then a second middle data value of a second side of 
10 said segment, said method comprising copying data from said first side of said 
segment to said second side of said segment. 

Alternatively, a result of said comparison i$ that a first middle data value of a 
first side of said segment is lower than a second middle data value of a second side of 
said segment, said method comprising copying data from said $econd side of said 
1 5 segment to said first side of said segment. 

Preferably, the data is image data. 

Preferably, the data is digital data. 

Preferably, the values are intensity values. 

Preferably* segmenting is carried out successively incrementally along said 
20 data stream. 

Preferably, copying is arranged to provide edge enhancement within said data. 
The embodiments may carry out maximal filtering or minimal filtering or, in 

a particularly preferred embodiment may concomitantly cany out maximal filtering 

and minimal filtering, whilst sharing said comparison outputs. 

25 



12 



07/12 04 TUE 20:27 FAX 972 3 6127575 



G. E. EHRLICH 



@031 



Brief Description of the Drawings 

For a better understanding of the invention and to show how the same may be 
carried into effect, reference will now be made, purely by way of example to the 
5 accompanying drawings. 

Fig. 1 is a simplifies flow chart showing a merge procedure that is more 
efficient than the GWVH merge procedure. 

Fig. 2 is a simplified flow chart showing a pre-processing procedure that is 
more efficient than the pre-processing in the GWVH algorithm 
0 Fig. 3 is a simplified flow chart showing a opening filter that is more efficient 

than running a set of data through a max GWVH filter, and then a min GWVH filter 



Description of the Preferred Embodiments 

Before Describing at least one embodiment of the invention in detail, it is to be 
15 understood that the invention is not limited in its application to the details of 
construction and the arrangements of the components set forth in the following 
description or illustrated in the drawings. The invention is applicable to other 
embodiments or of being practiced or carried out in various ways. Also it is to be 
understood that the phraseology and terminology employed herein is for the purpose 
20 of description and should not be regarded as limiting. 

Reference is now made to Fig.l which is a simplified flow chart of a first 
improvement to the GWVH algorithm. Using the notation introduced above recalling 
that we have segmented the data input into overlapping segments of 2p-l 5 where each 
segment has a center at % ? and each datum has an R, and a S value, the R's 

25 increasing from j^v backwards, the S's increasing from j£ forwards? we may state: 
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An algorithm can eliminate most of the comparisons in the merge process, in 
the following manner. Suppose that for some specific / it was found that 

5 R^S^ 

then for all k > i y it may be assumed: 

Rk — Ri ™ Sp-f-i - S P -k~i - 

and therefore there is no need to do the merge comparisons for all k> L 
Similarly if it is determined that 

then there is no need to do the comparisons for all k<i, Instead it is possible to 
simply assign all R ( .for i less then k to g . . 

The optimized procedure for doing the merge step is therefore a binary search. 
The improved GWVH algorithm may start begin making comparisons at ((p-2)/2) 20, 
15 and then continues with the remaining half of the segment. If the R k is less then or 

equal to $ k , then the improved GWVH algorithm is able to determine that for all i < 

k > R t 5 Sp-i-i ' ^ ^ ™pK>vcd GWVH algorithm may assign ihe determined 

maximum (max) to £ , ^ ^ improved GWVH algorithm then preferably 

searches through the remaining half of the problem 26. If the GWVH algorithm has 
20 completed the problem 28 it stops 36, otherwise, it continues 22. If the J£ t is greater 

then § k , then the improved GWVH algorithm knows that for all i > k, fa > 3 

and the improved GWVH algorithm may therefore simply assign the maximum (max) 
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to ft. 24. The improved GWVH algorithm then searches through the remaining half 

of the problem 32. If the GWVH algorithm has completed the problem 34 it stops 36, 
otherwise, it continues 22* 

Reference is now made to Fig. 2 which is a simplified flow chart of a second 
5 improvement to the GWVH algorithm. The GWVH algorithm makes 2 comparisons 
per datum to solve the preprocessing, to get all the ft k and $ k , It starts in the 

middle, and compares the next datum to the right, and the next datum to the left of the 
previous max. The GWVH algorithm preferably carries out such a comparison, at 
every datum, for every R, and S, giving a total of 2 comparisons per datum. 
10 A variable q is defined 

Let q — (p/2)+[(p mod 2)/2] 38. 

The first part of the improved GWVH implementation computes all the $ k for 

k=0 7 _._,q-l 40., and all the j> k for k=q 9 .«.,p 42. This is carried out using p-1 

comparisons, by assigning the next r, and s the greater of itself and the previous local 
1 5 max (in the same manner as the GWVH algorithm). 

The second part of the modified implementation of the pre-processing stage 
begins by comparing Sq _ x with f ff 44. If ^ > s then the improved GWVH 

algorithm knows that the overall maximum falls in one of j^,..., ^.Therefore it is 

unnecessary to compute the value of f^Tq^-^Ti > ^ther * c improved GWVH 

20 algorithm outputs j* q x = f - = T\~V q ^ continues to compute s q ^S P -i 46 - 

Similarly, if y <, then the improved GWVH algorithm knows that the 

overall maximum falls in one of x 0 > ->X -r Th ere fcre it becomes unnecessary for 
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the improved GWVH algorithm to compute the value of $ q $ x rather the 

algorithm outputs g = = ... = $ p _ r 48. In either case the improved GWVH 

algorithm requires (p/2)+[(p mod2)/2]-l comparisons, approximately 1.5 
comparisons per datum, instead of 2 comparisons per datum. 
5 Suppose the input data of a segment has its maximum located randomly in the 

segment, at location L In ihe first part of the pre-processing stage, we maintain a 
record of the index / at which the max value, the value stored at s . , where i goes 
from l,...,q-l was found. It is likewise possible to keep a similar record of the index 
/ 2 atwhichmax value, the value stored at y t , whereigoes fromp-l 1 ..^q was found. 

10 Once the comparison between ^ and is made, the further improved GWVH 

algorithm knows if /= \ x or if /= J (if ^ is larger, then /= ^ ? otherwise, /= / 2 ). All 

that remains to be computed from that datum and on, is the outputs Sq>S q +v~>Si~i in 

the case that , or otherwise y q .^T \-v~->Y V+i - The expected number of 

comparisons in this second stage is < — . In general it cannot be assumed that 

4 

15 arbitrary input to the preprocessing will have it's maximum value at a random 

location, but the further improved GWVH algorithm can achieve such an effect by 
choosing a random starting datum for the start of the segmentation. The random 
selection of a starting point does not degrade overall efficiency, due in the case that 
p«n (that the size of the window, the structuring element is significantly smaller that 

20 the total input size), as there need only be one random number generated for the entire 
input, which can be used for all segments. It should be noted that in general there is no 
need to actually pick a random starting point for the additional benefit, as most natural 
images are in large part random. 
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It is possible to compute the min and max of a give input more efficiently then 
computing both the min and max filter independently. Assume the algorithm is given 
a data input sequence Xo'*">X«- Compare the elements x 0 and X r The larger of 
the 2 becomes the running max, hereafter referred to as ^f. and the smaller of the 
5 two becomes the running min hereafter referred to as jYli ■ To compute M i+ \ w ^ 
yft^ compare j£. +1 ,and with each other. Compare fof. with the larger of the 
two. Compare ^ smaller of the two. At this stage, the algorithm has 

determined both j^f /+2 and m ^ , specifically = max(^f . >the larger of Xr+1 , 
and Xi+2 ) and mM =mm( m ,fte smaller of X/+1 , and Xm ). 

10 If there were no changes, Mm = Mm = Mi md m^m^tHi 

If both changed, the algorithm outputs — K^iMt 
larger of Xm , and Xt+1 ) = '^f M 
if only the maximum changed the algorithm outputs 

if the minimum changed the algorithm has to do an additional 
comparison to determine what jfl is 

the algorithm outputs fyf /+2 =M M ~Mt > 311(1 

m, +2 Mi > ^ 511131161 of !+ i > 911(1 X +2 > 
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and compares m with min( Xm , Xm ), if min( Xm , x+2 ) is smaller 
than ^ the algorithm outputs , m ^ = min (X (+ i > Xm ^ otherwise 
algorithm outputs m^ = m t • 

In the worst case the algorithm has to use 4 comparisons to find the 
5 largest and smallest values for each datum. Most cases will only require the 

first three comparisons^ giving the algorithm an advantage over the obvious 
solution. 

The further improved GWVH algorithm preferably uses the above result to 
obtain both the max, and the min output for a given input stream. Hie further 
10 improved GWVH algorithm uses this improvement on the upper and bottom halves of 
the algorithm (computing the necessary £ fc and p k for both the min, and the max in 
tliis manner. 



Reference is now made to Fig. 3 which is a simplified flow chart of how to 
15 compute an opening or closing filter in an efficient manner, that is to say in a manner 
that is more efficient than a sequential application of the Max filter and the min filter, 
or the min Filter and the Max filter. The opening filter may be defined as the result of 
applying the max filter to an input stream, and then applying the min filter to the 
output of the max filter. The closing filter may be defined as the result of applying 
20 the min filler to an input, and then applying the max filter to the output of the min 

filter- The remainder of the description will only concern itself with the application of 
the opening filter, though it should be clear to one skilled in the art that the results for 
the opening filter are equally applicable for the closing filter. 
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Firstly the algorithm applies the further improved GWVH algorithm max filter 
as described above, while preserving the partitions of the output 50. The results are 
then fed into the further improved GWVH algorithm min filter 62. The min 'filter 
preferably has access to the partitions already made by the max filter. Hie 
5 partitioning information may then be used for an efficient implementation of the pre- 
processing stage. The algorithm preferably knows that all the segments are either 
increasing, or decreasing, and knows for each segment whether that segment is 
increasing or decreasing. 

The efficient min filter for use with/in the opening filter with partitioning data 
1 0 preferably therefore: 

1 t Assigns the first value of the increasing segments to the 
entire preceding decreasing segment 52. 

2 + does a binary search on an increasing segment to find 
the first datum on the next decreasing segment that is within range 

15 p-1 that is smaller than or equal to the datum on the current 

increasing segment 54. For all data on the increasing segment 
before the first datum where the datum on the decreasing segment is 
within range p- 1 and is smaller than the datum on the increasing 
segment, the min is the value of the datum on the increasing segment 

20 56. On the first datum on the increasing segment before the first 

datum where the datum on the decreasing segment is within range p- 
1 and is smaller than the datum on the increasing segment, and after 
it, the pre-processing algorithm copies the data from the decreasing 
segment to the increasing segment 58 




Having efficiently pre-processed the data, the algorithm now goes on 
to efficiently merge the data as is seen in Fig. 1 60. 

It is appreciated that certain features of the invention, which are, for the sake 
of clarity, described in the context of separate embodiments may also be provided in 

5 combination in a single embodiment. Conversely, various features of the invention 
which are, for brevity, described in the context of a single embodiment, may also be 
provided separately or in any suitable combination. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 

10 hereinabove. For instance, the descriptions given define data processing on a 1 
dimensional data input It should be clear that similar efficient processing may be 
done on an n-dimensional data input where the data is analyzed first by rows, then 
columns then by the next dimension. Rather the scope of the present invention is 
defined by the appended claims and includes both combinations and sub- 

15 combinations of the various features described herein and above as well as variations 
and modifications thereof which would occur to persons skilled in the art upon 
reading the foregoing description. 



